Systems and methods using acoustic communication

ABSTRACT

Controlling one or more service providing devices, including a mobile device operative to control a service providing device within a first range, where the mobile device is operative to interrogate the one or more service providing devices within a second range being smaller than the first range, where, responsive to the interrogation by the mobile device, the service providing device identifies itself to the mobile device, and where the mobile device is operative to present to a user a list including one or more of the service providing devices within the second range.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/905,972, filed Jan. 19, 2016, which is a U.S. National PhaseApplication under 35 U.S.C. 371 of International Application No.PCT/IB2014/063266, which has an international filing date of Jul. 21,2014, and which claims the priority benefit of U.S. Provisional PatentApplication No. 61/856,729, and U.S. Provisional Patent Application No.61/856,730, both filed Jul. 21, 2013, and U.S. Provisional PatentApplication No. 62/021,018, filed Jul. 4, 2014, all of which areincorporated herein by reference.

FIELD OF THE INVENTION

The present invention generally relates to systems and methods usingacoustic communication, and, more particularly, but not exclusively, tomethods and systems for implementing personal area network (PAN)communication using acoustic technology.

BACKGROUND OF THE INVENTION

Personal area networks (PAN) and personal area communicationtechnologies are known. Such communication networks and technologiesprovide data interchange at a range of few meters, typically between 1meter and 10 meters. PAN communication technologies typically use radiowaves or infra-red (IR) waves. Common radio PAN technologies areBluetooth and Zigbee. IR communication technologies are mostly used forremote controls for their simplicity and because they do not penetrateroom walls. However, IR communication technologies need at leastnear-line-of-sight between the transmitter and the receiver. Radio PANtechnologies interfere with next door networks and therefore requirecomplex network registration processes. Radio PAN technologies consumemore power and are therefore useful mostly for rechargeable mobileunits. Acoustic communication is also known, but only for very shortrange communication, typically within few centimeters. There is thus arecognized need for, and it would be highly advantageous to have, amethod and a system for low power PAN networking that overcomes theabovementioned deficiencies.

SUMMARY OF THE INVENTION

Unless otherwise defined, all technical and scientific terms used hereinhave the same meaning as commonly understood by one of ordinary skill inthe art to which this invention belongs. The materials, methods, andexamples provided herein are illustrative only and not intended to belimiting. Except to the extent necessary or inherent in the processesthemselves, no particular order to steps or stages of methods andprocesses described in this disclosure, including the figures, isintended or implied. In many cases the order of process steps may varywithout changing the purpose or effect of the methods described.

Implementation of the method and system of the present inventioninvolves performing or completing certain selected tasks or stepsmanually, automatically, or any combination thereof. Moreover, accordingto actual instrumentation and equipment of preferred embodiments of themethod and system of the present invention, several selected steps couldbe implemented by hardware or by software on any operating system of anyfirmware or any combination thereof. For example, as hardware, selectedsteps of the invention could be implemented as a chip or a circuit. Assoftware, selected steps of the invention could be implemented as aplurality of software instructions being executed by a computer usingany suitable operating system. In any case, selected steps of the methodand system of the invention could be described as being performed by adata processor, such as a computing platform for executing a pluralityof instructions.

According to one aspect of the present invention there is provided aremote control method and system including one or more service providingdevice, and one or more mobile device operative to control one or moreof the service providing device within a first range, where the mobiledevice is operative to interrogate the one or more service providingdevices within a second range being smaller than the first range, where,responsive to the interrogation by the mobile device, the serviceproviding device identifies itself to the mobile device, and where themobile device is operative to present to a user a list including one ormore of the service providing devices within the second range.

According to another aspect of the present invention there is provided aremote control system and/or method where the one or more mobile deviceand the one or more service providing device use a first wirelesscommunication technology for communicating within the first range and asecond wireless communication technology for communicating within thesecond range, where the second wireless communication technology isdifferent from the first wireless communication technology.

According to yet another aspect of the present invention there isprovided a remote control system and/or method where the mobile deviceand/or the service providing device additionally include a receivermodule for receiving communication using the first wirelesscommunication technology, a transmitter module for transmittingcommunication using the first wireless communication technology, areceiver module for receiving communication using the second wirelesscommunication technology, and a transmitter module for transmittingcommunication using the second wireless communication technology.

According to still another aspect of the present invention there isprovided a remote control system and/or method where one or more of theservice providing device and the mobile device uses acousticcommunication for the interrogation.

Further according to another aspect of the present invention there isprovided a remote control system and/or method where the acousticcommunication uses a speaker embedded in the service providing deviceand/or the mobile device and where the speaker is used to provideaudible sound to a user, and a microphone embedded in the serviceproviding device and the mobile device and where the microphone is usedto receive audible sound from a user.

Yet further according to another aspect of the present invention thereis provided a remote control system and/or method where the control ofthe service providing devices by the mobile device is conditioned by theservice providing device being interrogated by the same mobile device.

Still further according to another aspect of the present invention thereis provided a remote control system and/or method where the control ofone or more of the service providing devices by the mobile device uses acode provided by the service providing device to the mobile deviceresponsive to the interrogation.

Even further according to another aspect of the present invention thereis provided a remote control system and/or method including a mobiledevice, and one or more local devices, where the local device iscommunicatively coupled to the mobile device, and where the local deviceis communicatively coupled to, and operative to control, one or moreservice providing devices, where the mobile device is operative tointerrogate the one or more local devices within a limited range, where,responsive to the interrogation by the mobile device, the local deviceidentifies the service providing device to the mobile device, and wherethe mobile device is operative to present to a user a list including oneor more of the service providing devices within the limited range.

Also, according to another aspect of the present invention there isprovided a remote control system and/or method where the local device iscommunicatively coupled to the mobile device using acousticcommunication technology, and where the local device and the mobiledevice are one or more meter away from each other.

According to yet another aspect of the present invention there isprovided a remote control system and/or method where the mobile deviceis a mobile telephone and the acoustic communication technology uses amicrophone and a speaker of the mobile telephone.

According to still another aspect of the present invention there isprovided a remote control system and/or method additionally including asecond local device, located outside the limited range, andcommunicatively coupled to the first local device, where the mobiledevice is operative to interrogate the second local device via the firstlocal device.

Further according to another aspect of the present invention there isprovided a remote control system and/or method where the first andsecond local devices are communicatively coupled using any of Wi-Fiwireless mechanism, Zigbee specification protocol, Bluetooth wirelessstandard, and power-line communication (PLC) technology.

Yet further according to another aspect of the present invention thereis provided a remote control system and/or method where the mobiledevice is operative to present to a user one or more service providingdevice associated with the second local device.

Still further according to another aspect of the present invention thereis provided a remote control system and/or method additionally includinga plurality of second local devices, where each of the second localdevices is associated with a location, where the mobile device isoperative to present to a user one or more of the locations, and where,responsive to user selection of a location, the mobile device isoperative to present to the user a list of service providing devicesassociated with the location.

Even further according to another aspect of the present invention thereis provided a remote control system and/or method including a serviceproviding device, and a mobile device including a microphone and aspeaker operative to communicate audible sound, a speech recognitionmodule operative in the mobile device, a transmitter operative in themobile device, and a receiver operative in the service providing device,where the mobile device is operative to use the speech recognitionmodule to detect a user command provided using speech and to transmit tothe service providing device a control command associated with thespeech command, and where the transmitter and the receiver use acousticcommunication at a communication range larger than one meter.

Also, according to another aspect of the present invention there isprovided a method and a system of a mesh network system including aplurality of acoustic modems, where each acoustic modem includes aprocessor, a memory, a speaker, a microphone, and a software programstored in the memory and executed by the processor, the software programoperative to use one or more of the speaker and the microphone tocommunicate with another acoustic modem using acoustic communication,where the acoustic modems are operative to communicate with each otherover a range larger than 1 meter, where the one or more of the acousticmodems is operative to receive from one or more second acoustic modem anidentification of one or more third acoustic modem within communicationrange of the second acoustic modem, and where the first acoustic modemis operative to communicate with the third acoustic modem via the secondacoustic modem.

According to yet another aspect of the present invention there isprovided a system and a method of a mesh network additionally includinga service providing device, a first local control device operative tocontrol the service providing device, a second local control deviceoperative to communicate with the first local control device usingacoustic communication, and a mobile device operative to communicatewith the second local control device using acoustic communication, wherethe mobile device operative to control the service providing device bycommunicating via the first and second local control devices.

According to still another aspect of the present invention there isprovided a system and a method including a first device and a seconddevice, each including a processor, a memory, a speaker for providingsound to a user, a microphone for receiving sound from a user, an audiocompression module, and/or an audio decompression module, and a softwareprogram stored in the memory and executed by the processor, where thesoftware program is operative to use a speaker and a microphone tocommunicate acoustic communication, where the first device is operativeto compress audio, and transmit the compressed audio using the acousticcommunication, and where the second device is operative to receive thecompressed audio using the acoustic communication, and decompress thecommunicated compressed audio.

Further according to another aspect of the present invention there isprovided a system and a method for a mobile device including amicrophone, a first input channel connected to the microphone andoperative to receive audio signals via said microphone in the frequencyrange of 0-20 KHz, and a second input channel connected to saidmicrophone and operative to receive audio signals via the samemicrophone in the frequency range of 14 KHz-20 KHz. The second inputchannel including: a filter operative to filter signals in the frequencyrange of 14 KHz-20 KHz, an amplifier operative to amplify signal fromthe filter, and an analog to digital converter. The filter, amplifierand analog to digital converter of the second input channel operateindependently of the first input channel. The second input channel isoperative to receive digitally coded acoustic information.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is herein described, by way of example only, withreference to the accompanying drawings. With specific reference now tothe drawings in detail, it is stressed that the particulars shown are byway of example and for purposes of illustrative discussion of theembodiments of the present invention only, and are presented in order toprovide what is believed to be the most useful and readily understooddescription of the principles and conceptual aspects of the invention.In this regard, no attempt is made to show structural details of theinvention in more detail than is necessary for a fundamentalunderstanding of the invention, the description taken with the drawingsmaking apparent to those skilled in the art how the several forms of theinvention may be embodied in practice.

In the drawings:

FIG. 1 is a simplified is a simplified illustration of a block diagramof an acoustic demodulator;

FIG. 2 is a simplified block diagram of a receiver for acoustic QAMdemodulator;

FIG. 3 is a simplified chart describing a modulated acoustic PPM signal;

FIG. 4 is a simplified block diagram of a DS-SS AWGN acoustic channel;

FIG. 5 is a simplified block diagram of a sequence detector;

FIG. 6 is a graph describing a hypothesis selection;

FIG. 7 is a graph showing an example of a DS-SS detection;

FIG. 8 is a block diagram of an acoustic modem;

FIG. 9 is a simplified block-diagram of three display screens of amobile device;

FIG. 10 is a simplified illustration of a mobile device communicatingwith an IR switch;

FIG. 11 is a simplified block-diagram of a mobile device communicatingwith a TV set via an IR switch;

FIG. 12 is a simplified illustration of mobile device communicating withan IR switch, and a remote controller;

FIG. 13 is a simplified illustration of a mobile device communicatingwith an IR switch, a TV set and a DVD recorder;

FIG. 14 is a simplified illustration mobile device communicating with anIR switch, a TV set, and a power line communication RF unit;

FIG. 15 is a simplified illustration mobile device communicating with aplurality of IR switches, and a plurality of home appliances;

FIG. 16 is a simplified illustration mobile device communicating with aplurality of IR switches and a plurality of home appliances distributedin secluded areas;

FIG. 17 is a simplified illustration of an interface screen display;

FIG. 18 is a simplified illustration of an IR switch, a powerconnection, and a TV set;

FIG. 19 is a simplified illustration of mobile device communicating witha wireless router, an IR switch, a power connection, and TV set;

FIG. 20 is a simplified flowchart of a procedure for associating mobiledevice with a particular appliance;

FIG. 21 is a simplified flowchart of a procedure for operating a mobiledevice as a remote controller with reference to FIG. 11;

FIG. 22 is a simplified flowchart of a another procedure for operatingmobile device as a remote controller with reference to FIGS. 8 and 9;

FIG. 23A and FIG. 23B are two simplified flowcharts of correspondingprocedures for an IR switch;

FIG. 24 is a simplified flowchart of a learning mode procedure in amobile device;

FIG. 25 is a simplified flowchart of a procedure for an IR switch in alearning mode;

FIG. 26 which is a simplified illustration showing a mobile devicecommunicating with a CANbus switch a and vehicle;

FIG. 27 is a simplified illustration of an acoustic toy system;

FIG. 28 is a simplified schematic illustration of the acoustic toysystem with a block diagram of a toy;

FIG. 29 is a simplified illustration of an acoustic multi-toy system;

FIG. 30 is a simplified illustration of the acoustic toy system and a TVset;

FIG. 31 is a simplified block-diagram of a toy audio file as used by theacoustic toy system;

FIG. 32 is a simplified flowchart of a play script as used by theacoustic toy system;

FIG. 33 is a simplified flowchart of an acoustic toy main program;

FIG. 34 is a simplified flowchart of a notification script;

FIG. 35 is a simplified flowchart of a TV show synchronizationprocedure;

FIG. 36 is a simplified flowchart of TV show play script;

FIG. 37A is a simplified flowchart of a toy notification script;

FIG. 37B is a simplified flowchart of a phone notification script; and

FIG. 38 is a simplified block-diagram of a TV show sound track.

DETAILED DESCRIPTION OF THE INVENTION

The principles and operation of a method and a system for using acousticcommunication according to the present invention may be betterunderstood with reference to the drawings and accompanying description.

Before explaining at least one embodiment of the invention in detail, itis to be understood that the invention is not limited in its applicationto the details of construction and the arrangement of the components setforth in the following description or illustrated in the drawings. Theinvention is capable of other embodiments or of being practiced orcarried out in various ways. Also, it is to be understood that thephraseology and terminology employed herein is for the purpose ofdescription and should not be regarded as limiting.

In this document, an element of a drawing that is not described withinthe scope of the drawing and is labeled with a numeral that has beendescribed in a previous drawing has the same use and description as inthe previous drawings. Similarly, an element that is identified in thetext by a numeral that does not appear in the drawing described by thetext, has the same use and description as in the previous drawings whereit is described.

The purpose of the system and method of using acoustic communication, isto implement a personal area network (PAN) using acoustic technology.This enables communication of packet and/or streaming data (e.g. sound,voice, etc.) within a range of 1 to 10 meters, typically indoors, butoptionally also outdoors. A typical use of PAN is for remote controldevices such as for operating air-conditioning systems, homeentertainments systems (television units, set-top-boxes, audio systems,home theater systems, etc.), computers and video games, toys, etc., andgenerally in the area of home control.

Several possible methods of acoustic communication for implementation ofa remote controller are now described.

Technical information:

The “theoretical achievable” rate based on the Shanon theory, is givenby:

Max_Bit_rate=2000 log₂(SNR+1)=2000 log₂(10^((−8/10))+1)=424 BPS

if the receiver is designed with 5 to 10 dB distant from the above,then:

Possible_Bit_rate=2000 log₂(SNR+1)=2000 log₂(10^(((−8−10)/10))+1)=45 BPS

It is possible to use a simple microphone with a good amplifier workingat the range of 18000-20000 Hz, and get an acoustic remote controllerworking at the rate of 30-36BPS, at a distance of 10 meters and inbetween rooms

Possible Modulation Methods to Implement the Remote Controller:

1. Frequency Shift Keying (FSK)

The delay spread of the Channel Impulse response (CIR) is about 0.1 sec,therefore in order to implement simple FSK, one would need to mitigatethe multipath therefore symbol rate must be greater than 0.1 sec. So 0.3sec will do the job, however, having such a low symbol rate would implythat the bit rate of one FSK channel would be 3BPS, so in order to have36BPS, one would need about 12 FSK channels.

Also packet header is needed, so if there is about 12bits every 0.3 sec,it is required to add about 8 bits for CRC and header. This would meanthat it is required about 60BPS or 20 channels of FSK modem, and thateach would occupy 100 Hz bandwidth

Reference is now made to FIG. 1, which is a simplified illustration of ablock diagram of a demodulator 10, according to one embodiment of thepresent invention.

As shown in FIG. 1, demodulator 10 is an 8-channel multi-FSKdemodulator. Element 11 of demodulator 10 processes time and header. Itis noted that the transmitter/controller has a predefined signalsequence. The 8-channel multi-FSK demodulator is implemented as follows:

Let {f_(a,1), f_(b,1)}, {f_(a,2), f_(b,2)}, . . . , {f_(a,20), f_(b,20)}be the 20 channels of the FSK

the first above notch level:

-   -   notches out all the a's and it results with {f_(b,1), f_(b,2), .        . . , f_(b,20)}

the first above notch level:

-   -   notches out all the b's and it results with {f_(a,1), f_(a,2), .        . . , f_(a,20)}

then the second level of notch filters would now divide the results intotwo groups for the b and it results with {f_(b,1), f_(b,3), . . . ,f_(b,17)} and {f_(b,2), f_(b,4), . . . , f_(b,20)}

for the a, it results with: {f_(a,1), f_(a,3), . . . , f_(a,17)} and{f_(a,2), f_(a,4), . . . , f_(a,20)}

The above operation continues until there is for each output onefrequency left, then an Absolute value is calculated for each of thefrequencies and the value for the “0” is subtracted from the value ofthe “1” and a smoothing moving average filter is applied. This willgenerate a demodulated “square wave” showing the bit stream at eachchannel. Each bit stream would be described by at least 16 samples,hence, a timing module is needed. The timing is done using a search forthe best timing. Data is received whenever, the packet header isreceived.

MIPS Estimation for this Method:

For n frequencies notch there is a need for about 2*n+1 taps. This meansthat there is a need to have the following amount of taps:

2×(21+2×11+4×7+8×3)=˜200Taps, 200Taps running at 44100 Hz plus the inputfilter would give about 16MIPS for a mediocre receiver

2. Quadrature Amplitude Modulation (QAM)

It is referred to QPSK, QAM and M-QAM (known as OFDM). Basic receiverhere includes pre-processing of the input signal some parameterestimation e.g. phase and gain, timing and equalization.

Reference is now made to FIG. 2, which is a simplified block diagram ofa receiver for QAM demodulator 12, in accordance with one embodiment ofthe present invention.

Regarding the QAM demodulator receiver 12 of FIG. 2, this kind ofreceiver, (or an OFDM receiver) could not work with SNR's as low as−5-−8 dB. This is due to the fact that

-   -   Equalization estimation (QAM & OFDM) could not give good results        with low SNR's.    -   Parameter estimation (phase, gain timing etc.) could not work        with low SNR's.

The length of the equalizer should be at least 0.3 sec. This means thatone would need at 10000 Hz (4 times the symbol rate) to have 3000 Tapsfor the equalizer. With 5 cycles per tap, this would mean5000×3000×5=75MIPS

3. Pulse Position Modulation

This method uses the location of pulses to transmit the information,usually a differential method.

Reference is now made to FIG. 3, which is a simplified chart describinga modulated PPM signal, according to one embodiment of the presentinvention.

This method is not suitable for highly dispersive channels

4. Direct Sequence-Spread Spectrum (DS-SS)

This method provides transmission of a random +/−1 signal with length ofN. This method is a very robust method for a multipath channel, and canuse the multipaths to improve reception.

A tutorial explanation for the benefits of this method:

Reference is now made to FIG. 4, which is a simplified block diagram ofa DS-SS AWGN channel, as provided and employed in accordance with oneembodiment of the present invention.

Let: {b₀, b₁, . . . , b_(N-1)} where b could +1 or −1 be the transmittedsignal

Let the transmitted signal pass through the channel of FIG. 4.

The received signal is described by y[n]=ax[n]+v[n]

where:

-   -   x is the transmitted signal    -   a is the channel attenuation    -   v is the AWGN noise

Reference is now made to FIG. 5, which is a simplified block diagram ofa sequence detector, according to one embodiment of the presentinvention.

The receiver for the transmitted sequence is described with reference toFIG. 5 as follows:

-   -   Out of correlation there is:

${out} = {{\frac{1}{N}{\sum\limits_{k = 0}^{N - 1}{b_{k}v_{n - k}}}} \pm \frac{a}{N}}$

-   -   In correlation there is

${out} = {{\frac{1}{N}{\sum\limits_{k = 0}^{N - 1}{b_{k}v_{n - k}}}} + a}$

The above means that for

-   -   Out of correlation there is

E{out} ≈ 0 ${E\left\{ {out}^{2} \right\}} = \frac{\sigma_{v}^{2}}{N}$

-   -   In correlation there is

E{out} ≈ a${{{Var}\left\{ {out} \right\}} = \frac{\sigma_{v}^{2}}{N}},{{E\left\{ {out}^{2} \right\}} = {\frac{\sigma_{v}^{2}}{N} + a^{2}}}$

This means that the following two hypothesis exist, as shown throughreference to FIG. 6, which is a graph describing Hypothesis selection,according to one embodiment of the present invention.

Reference is now made to FIG. 6, which is a graph describing ahypothesis selection, according to one embodiment of the presentinvention.

As seen in FIG. 6, a threshold of a/2 would be a good choice for thesame miss detect and false alarm probabilities.

The SNR is

${SNR} = \frac{a^{2}}{\sigma^{2}}$

this means that the width of the Gaussian above is given by:

$\frac{\sigma_{v}^{2}}{N} = \frac{a^{2}}{N \cdot {SNR}}$

For a given SNR, increasing N would enable working with extremely lowSNR's

Reference is now made to FIG. 7, which is a graph showing an example ofa DS-SS detection, according to one embodiment of the present invention.

In FIG. 7, the signal is presented as a bold line designated by numeral13, and the noise is presented as a light line designated by numeral 14.Signal 13 is the sequence, and while it is immersed in noise 14, it bedetected with probability of false or miss as low as 1e-6.

Reference is now made to FIG. 8, which is a block diagram of an acousticmodem 15, according to one embodiment of the present invention.

As seen in FIG. 8, acoustic modem 15 includes two main parts: analogfront-end module 16 and base-band processing module 17 communicativelycoupled. The analog front end module 16 also connects to a microphone 18and a speaker 19. It is appreciated that analog front end module 16 mayoperate more than one microphone 18 and/or a speaker 19. The base-bandprocessing module 17 connects via communication links 20 to a higherlevel processing facility such as an application processor (not shown).

The analog front end module 16 typically includes an input circuitryconnected to microphone 18 and an output circuitry connected to speaker19. The input circuitry includes two channels, a sound oriented firstinput channel and a modem oriented second input channel. The first inputchannel includes a low band amplifier and filter 21 and ananalog-to-digital (ADC) converter 22 connected to the input of an analogaudio circuitry of the host device (e.g. a mobile device, a TV set,etc.)

The low pass amplifier and filter 21 typically carries uncoded (analog)sound, music, speech, etc. For example in the frequency band of 0 to 14KHz. It is appreciated that the 14 KHz limit is arbitrary and can be 15KHz, 18 KHz or any other frequency lower than 20 KHz. The second inputchannel is intended to carry coded modem data and includes a band passamplifier and filter 23 and an analog-to-digital (ADC) converter 24. Inthis example, band pass amplifier and filter 23 communicates thefrequency band of 14 KHz to 20 KHz.

It is appreciated that it is advantageous to embed this dual channelsystem in any device implementing acoustic communication, includingmobile devices such as smartphones, and tablets, and service providingdevices such as television (TV) and audio systems.

The output circuitry of analog front end module 16 includes a soundoriented first output channel 25 and a modem oriented second outputchannel 26, typically corresponding to the first and second inputchannels. The first output channel 25 is typically a low pass filter inthe frequency band of 0 to 14 KHz, and the second output channel 26 istypically a band pass filter for the frequency band of 14 KHz to 20 KHz.The signals passing through the first and second output channels arecombined at 27, and fed via digital-to-analog converter (DAC) 28 andoutput amplifier filter 29 (typically 0 to 20 KHz) to speaker 19. Thefirst output channel is typically connected to the output of an analogaudio circuitry of the host device (e.g. a mobile device, a TV set,etc.)

Base-band processing module 17 includes a modulator channel and ademodulator channel. The modulator channel receives data from a higherlevel processing facility such as an application processor into datalink layer 30, connected to a forward error correction (FEC) module 31,which is connected to a data-symbols pre-processing and mapping module32, which is connected to a fast-Fourier-transform (FFT) module 33,which is connected to a front-end Digital signal processor (DSP)transmitter 34, which connects to the output channel of the analog frontend module 16.

The demodulator channel receives coded audio signal from the secondinput channel of analog front end module 16. The coded audio signal isreceived into a front-end Digital signal processor (DSP) receiver 35,connected to a fast-Fourier-transform (FFT) module 36, which isconnected to a data symbols extractor module 37 and to a noise Dopplerdispersion channel estimator 38.

Data symbols extractor module 37 connects to a data symbols estimator39, which connects to a forward error correction module 40, whichconnects to a data link layer module, 41, connecting to a hostapplication processor or a similar processing facility.

Noise Doppler dispersion channel estimator 38 connects to the datasymbols extractor module 37, to data symbols estimator 39, and toforward error correction module 40.

Acoustic modem 15 shown in FIG. 8 may be embedded in smart phone or atablet. The analog front-end of the smart phone tablet provides a goodquality acoustic modem on the receiver side (higher analog to digitalconversion dynamic range—with mitigation of interference from audiovoice and music signals) and maximum volume on the transmitter side. Theoperation of acoustic modem 15 is not affected by the local volumecontrol of the smart phone or tablet, which controls only the audiovoice and music volume.

The signal on the receiver side is first processed by a front-endprocessing such as mixing, re-sampling, shaping, etc., to prepare thereceived signal for signal processing algorithm. Next the signal isconverted to the frequency domain, in which the noise, dispersion,Doppler and channel are estimated. Using these data parameters thecoherent modem can extract the data symbols and run a FEC (Forward ErrorCorrection) and pass the signal to a link layer.

On the transmitter side, data bits are first passed through a FEC andthen these bits are mapped in a certain way to allow reception inextremely fast changing dispersive noisy channel. The symbols are laterconverted to a time domain and the signal is pre-processed by the frontend processing transmitter side. The output of the front end DSPprocessing is mixed with audio voice or music. There is no interferencesince acoustic modem and audio voice/music are in different bands.

Mobile telephones, computers and other devices having microphones andspeakers can transmit and receive audio signals in the frequency band of0-20,000 Hz. However, in most cases, only 0-8,000 Hz is used. The audiospectrum above 14000 Hz is rarely used and have low acoustic noise.Furthermore, humans can usually hear up until 14,000 Hz, which makes theregion of 14,000 Hz-20,000 Hz useful for acoustic communication. Acommon microphone would have a noise density of about 10-18 nv/sqrt(Hz).The noise floor in the band of the acoustic communication is therefore:

V _(n)=10 nv√{square root over (6000)}=0.77·10⁻⁶v=0.77 μv  Eq. (1)

Audio signal received by a microphone from music and voice in the bandof 0-8000 Hz would generate about 1 mv-5 mv. Assuming an amplifierhaving gain of 1000, the signal amplitude at the output of an amplifieris approximately 1 vptp for the 0-8000 Hz. Using 16 bits analog todigital converter a 1 bits step is:

$\begin{matrix}{{\left. {1{Bit}} \right){Step}} = {\frac{1}{2^{16}} = {15.2\mspace{14mu} \mu \; v}}} & {{Eq}.\mspace{14mu} (2)}\end{matrix}$

Therefore, the acoustic communication signal should provide at least15.2 uv per bit, and 5 bits resolution requires a signal of 32*15 uv=480uv

As seen in FIG. 8, the input circuitry is divided into a sound inputchannel and a communication input channel, each with its ownfilter-amplifier (21 and 23) and ADC (22 and 24). The communicationinput channel (filter-amplifier 23 and ADC 24) operating in the14000-20000 Hz frequency band.

Therefore, the communication input channel has good resolution even forvery low signals of just 1.4 uv (SNR=6 dB). Amplifier gain of 1000provides a signal of 14 mv and a 16 bits ADC provides 9.8 bitsresolution. This requires only 1.4 uV to accommodate signal-to-noiseratio (SNR) of 6 dB, compared with 30 uV without the additionalcommunication channel, providing improvement of 26 dB.

Reference is now made to FIG. 9, which is a simplified block-diagram ofthree display screens of a mobile device, according to one embodiment ofthe present invention.

FIG. 9 shows a mobile-device 42, such as a mobile telephone, asmartphone, a tablet, etc., functioning as a controller. typicallyprovides the user with a list of categories of home appliance including:TV sets, stereo systems, air-condition systems, electric blinds and thelike. The categories are typically shown to the user on a touch-screen,allowing the user to select the category of appliances to be added tothe controller system, for example, TV sets. The mobile device thentypically connects to the Internet, and presents to the user a list offirms, from which the user selects the firm of the appliance inquestion, such as Sony in the present example.

Turning to FIG. 9 it is seen that, having selected to add a Sony TV, theuser is now presented with screen 43 displayed by mobile phone 42. Asshown in FIG. 9, Screen 43 includes a list of models of Sony TV sets,which the mobile device typically downloads from the Internet. Havingselected the required model form the list, the user is presented withscreen 44 with “select” and “cancel” buttons for the model in question.As further seen in FIG. 9, once the user has pushed the “select” button,the mobile phone 42 communicates with a suitable server 45. Mobile phone42 typically communicates with server 45 over a communication network 46such as the Internet. Mobile phone 42 downloads (screen 47) from server45 a list of control codes, such as used by a universal controller forcontrolling the appropriate TV model. Namely a list which includes allthe IR codes for the TV set, detailing which code is required foractivating each function on the TV set.

Reference is now made to FIG. 10, which is a simplified illustration ofa mobile device 42 communicating with an IR switch 48, according to oneembodiment of the present invention.

Turning to FIG. 10 it is seen that mobile device 42 communicateswirelessly, via a communication network 46 such as the Internet, with anInternet server 45, which provides IR codes for controlling a selectedTV set. Having downloaded the IR codes with their corresponding commandnumbers, mobile device 42 transfers the codes to IR switch 48, typicallyvia acoustic communication with IR switch 48. IR codes are transmittedby mobile device 42 via speaker 49 and received by IR switch 48 viamicrophone 50. A new device category is then opened in a memory unit 51on IR switch 48, storing all command numbers with their corresponding IRcodes for the TV set.

A feedback announcement is then transmitted by IR switch 48 via speaker52 and received by mobile device 42 via microphone 53. Mobile device 42then shows the user an announcement, informing the user that the TV sethas been successfully added to the controller system. From that momenton, any command number signaled by the user by means of mobile device42, is acoustically received by IR switch 48 which is now operative tofind the corresponding IR code in its memory unit and transmit the IRcode to the TV set in question, via IR transmitter 8 on IR switch 48.

IR switch 48 has a power connection or runs on batteries. IR switch 48is typically placed in a such a way that IR transmitter 54 is directedat the IR receptor of the TV set. Alternately, IR switch 48 is capableof transmitting IR signal which do not require a direct line-of-sight,such as defused IR. In that case, IR switch 48 is placed at a suitablelocation, and is operative to transmit IR signal to any device in thesame room.

It is appreciated that the embodiment of FIG. 10 is suitable for caseswherein the IR codes are rather long. In other cases, it is possible toemploy a system wherein mobile device 42 does not transmit a commandnumber but an acoustic signal which includes an entire IR code, and IRswitch 48 is operative to convert the signal to its corresponding IRcode, to be transmitted to the TV set. In this alternativeconfiguration, IR switch 48 does not require a memory unit for an entirecode list, but only a small memory for the IR code for “1” and “0”,allowing IR switch 48 to produce an IR code in real time for any bitsequence received from mobile device 42.

Reference is now made to FIG. 11, which is a simplified block-diagram ofmobile device 42 communicating with a TV set 55 via IR switch 48,according to one embodiment of the present invention.

Turning to FIG. 11, it is seen that a mobile device 42, which includesan antenna providing Internet connection, presents to the user a TVcontroller screen including: On/Off buttons, channel buttons, and volumeUp/Down buttons, as well as box showing what command has been activated.Mobile device 42 communicates acoustically with an IR switch 48, viaspeaker 49 and microphone 53 on mobile device 42 and speaker 52 andmicrophone 50 on IR switch 48. In the present example, an acousticsignal including an appliance number and an IR code number istransmitted by mobile device 42 via speaker 49, which signal is receivedby IR switch 48 via microphone 50. Having received the appliance and IRcode numbers, IR switch 48 retrieves from its memory the correspondingIR code for the appliance—a TV set 55—and transmit the IR code to theappliance via an IR transmitter 54.

Alternately, an acoustic signal including an IR code bit sequence istransmitted by mobile device 42 and received by IR switch 48, which bitsignal is directly transmitted as an IR code to TV set 55 via IRtransmitter 54.

Reference is now made to FIG. 12, which is a simplified illustration ofmobile device 42, IR switch 56, and a remote controller 57, according toone embodiment of the present invention.

Turning to FIG. 12, it is seen that a mobile device 42, equipped with awireless Internet connection, presents a TV controller screen to theuser including: On/Of buttons, volume Up/Down and channel Up/Downbuttons. Mobile device 42 communicates acoustically with an IR switch56, via speaker 49 and microphone 53 on mobile device 42 and speaker 52and microphone 50 on IR switch 56. IR switch 56 is equipped with IRtransceiver 58, which is capable of transmitting and receiving IRsignals.

In the present example, the user has selected the now flashing volume Upbutton, in order to load a controller system with the IR code for thevolume Up command. The selection is acoustically signaled by mobiledevice 42 to IR switch 56. At the same time, the user transmits an IRcode for the volume Up command, by means of a remote controller 57,which is typically supplied together with an appliance in question, suchas a TV set. The IR code from remote controller 57 is received by IRswitch 56 via transceiver 58, and stored in a memory unit on IR switch56. At the same time, IR switch 56 acoustically communicates the IR codeto mobile device 42, which is operative in turn to upload the code to anInternet server with which it wirelessly communicates. In the same way,the controller system of FIG. 12 can be loaded with all the required IRcodes for the control commands of the TV set in question, so that anentire IR code library can be created for the appliance and uploaded tothe Internet server.

It is appreciated that the system of FIG. 12 is particularly appropriatefor cases where an IR code library for a given home appliance is notavailable for download from the Internet. It is also appreciated thatthis system is particularly advantageous, in that it allows to uploadthe IR code library to the Internet and make it available for futuredownload by the same as well as other users of the appliance inquestion. For example, is a user has two TV sets of the same model intwo separate rooms, the learning process for the IR codes needs to beperformed only once.

Reference is now made to FIG. 13, which is a simplified illustration ofa mobile device 42, IR switch 48 (or IR switch 56), TV set 55 and a DVDrecorder 59, according to one embodiment of the present invention.

Turning to FIG. 13, it is seen that a mobile device 42, equipped with awireless Internet connection and speech-recognition capability, presentsa TV controller screen to the user including: On/Of buttons, volumeUp/Down and channel Up/Down buttons. A speech-recognition capability formobile phones is provided, for example by Apple's Siri. Mobile device 42communicates acoustically with an IR switch 48, via speaker 49 andmicrophone 53 on mobile device 42 and speaker 52 and microphone 50 on IRswitch 48.

In the present example, a user 60 has given a speech command for “volumeUp”, which is received by mobile device 42 via microphone 53. Mobiledevice 42 retrieves from its memory unit the command number for “volumeUp”, and acoustically communicates the number to IR switch 48. IR switch48 in turn retrieves from its own memory unit the corresponding IR codeand transmits it to a TV set 55 via an IR transmitter 54 (Or, if IRswitch 56 is used, via transceiver 58). It is noted that microphone 53is used by mobile device 42 to receive acoustic communication from IRswitch 48 (or 56) and to receive speech commands from user. 60. It isappreciated that mobile device 42 may use microphone 53 to receiveacoustic communication from IR switch 48 (or 56) and to receive speechcommands from user. 60 simultaneously, at the same time.

Aside from providing ease of use, speech-recognition capability alsoallows the reception of more elaborate, natural language commands, whichcannot be received through preset buttons on the mobile device'stouch-screen. As also seen in FIG. 13, mobile device 42 receives aspeech command “Record Sex and the City” by the user. Mobile device 42then retrieves from the Internet the channel, date and time of the nextepisode of the TV series in question, and acoustically communicates asuitable command to IR switch 48. The command directs IR switch 48 totransmits an IR signal to DVD recorder 59, setting DVD recorder 59 toschedule a recording in accordance with the channel, date and time.

Reference is now made to FIG. 14, which is a simplified illustrationmobile device 42, IR switch 48 (or IR switch 56), TV set 55 and a powerline communication RF unit 61, according to one embodiment of thepresent invention.

Turning to FIG. 14, it is seen that a mobile device 42, equipped withspeech-recognition capability, presents a TV controller screen to theuser including: On/Of buttons, volume Up/Down and channel Up/Downbuttons. A speech-recognition capability for mobile phones is provided,for example by Apple's Siri. Mobile device 42 communicates acousticallywith an IR switch 48, via speaker 49 and microphone 53 on mobile device42 and speaker 52 and microphone 50 on IR switch 48.

In the present example, user 60 has given a speech command for “volumeUp”, which is received by mobile device 42 via microphone 53. Mobiledevice 42 retrieves from its memory unit the command number for “volumeUp”, and acoustically communicates the number to RF switch 48. RF switch48 in turn retrieves from its own memory unit the corresponding RF codeand transmits it to a TV set 55, with which it communicates wirelessly.

Wireless communication between RF switch 48 and a home appliance such TVset 55 is typically established via Wi-Fi wireless mechanism, Zigbeespecification protocol, Bluetooth wireless standard and/or any suitablewireless communication method. Alternately or in addition, power-line“data-over-power” communication is employed, using a power-line RF unit61, which communicates with RF switch 48, employing, for example, one ofthe above-mentioned wireless communication method. A single power-lineRF unit can then be employed for controlling all appliance in the housevia power-line communication (PLC).

It is appreciated that mobile device 1 can also communicate with the RFswitch 48 via Wi-Fi, Bluetooth, Zigbee, or any other suitable wirelesscommunication method.

Reference is now made to FIG. 15, which is a simplified illustrationmobile device 42, a plurality of IR switches 48 (or IR switches 56), anda plurality of home appliances 62, according to one embodiment of thepresent invention.

Turning to FIG. 15, it is seen that a mobile device 42, equipped withspeech-recognition capability, presents a TV controller screen to theuser including: On/Of buttons, volume Up/Down and channel Up/Downbuttons. A speech-recognition capability for mobile phones is provided,for example by Apple's Siri.

Mobile device 42 communicates acoustically with IR switch 48 designatedby numeral 63, which in turn communicates acoustically with another IRswitch 48 designated by numeral 64. Acoustic communication betweenmobile device 42 and IR switch 63, as well as between the two IRswitches 63 and 64, is established via speakers and microphones on thedevices as described above with reference to FIG. 1-14. Alternately orin addition, IR switches 63 and 64 may communicate with one anotherwirelessly via Wi-Fi wireless mechanism, Zigbee specification protocol,Bluetooth wireless standard and/or any suitable wireless communicationmethod.

In the present example, the user has given a speech command for “volumeUp”, which is received by mobile device 42 via a microphone on mobiledevice 42. Mobile device 42 retrieves from its memory unit the commandnumber for “volume Up”, as well as the device number for the command inquestion, and communicates it acoustically to IR switch 63 together witha device number, referring to TV set 55 in the present example. Based onthe device number, IR switch 63 communicates the command number to IRswitch 64, which in turn retrieves from its memory unit thecorresponding IR code and transmits it to TV set 55 via an IRtransmitter on IR switch 64.

It is appreciated that the system of FIG. 15 allows a plurality of IRswitches 48 (and/or IR switches 56) to serve as repeaters, thereby tocarry an acoustic message by a mobile device to any appliance around thehouse.

Reference is now made to FIG. 16, which is a simplified illustrationmobile device 42, a plurality of IR switches 48 (or IR switches 56), anda plurality of home appliances 65 distributed in secluded areas 66,according to one embodiment of the present invention.

Turning to FIG. 16, it is seen that mobile device 42 equipped withspeech-recognition capability presents a TV controller screen to theuser including: On/Of buttons, volume Up/Down and channel Up/Downbuttons. A speech-recognition capability for mobile phones is provided,for example by Apple's Siri.

While present in a particular room in the house (e.g. a first secludedarea 66 designated by numeral 67), mobile device 42 is operative tocommunicate acoustically with IR switch 63, which is located in the sameroom. In the present example, IR switch 63 placed at a living room (67)and IR switch 64 is placed at a bed room e.g. a second secluded area 66designated by numeral 68). Acoustic communication between the mobiledevice and IR switches 63 and 64 is established via speakers andmicrophones on the devices as described above with reference to FIG.1-15.

Mobile device 42 is also equipped with room detection capability,allowing mobile device 42 to determine the room in which it is present.Room detection capability employs, for example, object identificationbased on one or more pictures of the room's interior which are receivedvia the mobile device's camera. Alternately or in addition, an IRswitches distributed in the rooms (secluded areas 66) continuallycommunicate their IDs via acoustic beacon signals. An acoustic beaconsignal of a particular IR switch is received by mobile device 42 only ifit is located in the same room with the IR switch. Based on an IR switchID, the mobile device can determine the room in accordance with apreviously stored home arrangement, which the user has entered via asuitable interface, as described below with reference to FIG. 17.Alternately or in addition, a GPS chip on the mobile device allow roomdetection.

Based on the detection of a room, mobile device 42 retrieves from itsmemory unit a room configuration which describes the relationshipbetween appliances in the room in question. In the present example, inthe living room 67, the sound for TV set 69 is provided via a stereosurround system 70, whereas in the bedroom 68, TV set 71 employs its ownsound system. Accordingly, while in the living room 67, the voicecommand “volume up” causes the mobile device to communicate a commandnumber to IR switch 63, thereby to cause IR switch 63 to transmit a“volume up” IR code to the stereo surround system 70. Whereas while inthe bedroom 68, the same voice command “volume up” causes the mobiledevice 42 to communicate a command number to IR switch 64, thereby tocause IR switch 64 to transmit a “volume up” IR code to TV set 71.

Reference is now made to FIG. 17, which is a simplified illustration ofan interface screen display, according to one embodiment of the presentinvention.

Turning to FIG. 17, it is seen that a “My Home” interface screendisplays multiple rooms, a living room and a bedroom in the presentexample, showing the appliances and the IR switches in each room. Viathis interface, which is available on the Internet and/or on a mobiledevice, a user may determine which appliances are to be controlled ineach room, and also the control functions associated with eachappliance. The user may also determine which IR switch is located ineach room.

In the present example the sound for TV set 69 in the living room 67 isprovided via audio surround system 70 (rather than TV set 69 ownspeakers). In the bedroom 68 the sound for TV set 71 is provided by theTV set 71 speakers. Additionally, IR switch 63 is assigned to the livingroom 67, and IR switch 64 is assigned to the bedroom 68

Based on the home arrangement as provided via this interface, the mobiledevice determines which appliance is to perform a given command by theuser in each room. The mobile device is operative to detect the roomwherein it is present, for example, via acoustic beacon signals by theIR switch inside the particular room, which signals carry the IR switchID. Thus in the present example, receiving a beacon signal from IRswitch 63, allows the mobile device to determine that it is located inthe living room 67. In response to a “volume up” command by the user,the mobile device will therefore transmit a command code to IR switch63, thereby IR switch 63 transmits a “volume up” IR code to the stereosurround system 70. In the bedroom 68, the same voice command “volumeup” causes the mobile device to communicate a command number to IRswitch 64, thereby IR switch 48 transmits a “volume up” IR code to TVset 71.

As disclosed above with reference to FIGS. 15, 16, and 17, a pluralityof local devices such as IR switches 48 may form a network of localdevices, or IR switches 48 (or IR switches 56). The network enables theIR switches 48 to communicate data between themselves. The plurality oflocal devices, or IR switches 48, is typically arranged in form of amesh network, enabling any local device, or IR switch 48 to communicatewith any other local device, or IR switch 48 within its range. The meshnetwork also enables any local device, or IR switch 48, to use a secondlocal device, or IR switch 48, as a relay, enabling the first localdevices, or IR switches 48 to communicate data to a third local device,or IR switch 48, via the second local device, or IR switch 48.

As disclosed herein, the communication within the mesh network may useany appropriate communication technology, or a combination ofcommunication technologies. Any pair of local devices, or IR switches 48within the mesh network may use acoustic communication, for example forcommunicating within a large room, a corridor, a staircase, etc., andPLC or wireless communication to communicate between rooms or acrosswalls, or larger distances.

It is appreciated that the mesh network enables a plurality of mobiledevices 42 to remotely control a plurality of service providing devicessuch as TV sets 55 by relaying communication via the plurality of localdevices, or IR switches 48.

Reference is now made to FIG. 18, which is a simplified illustration ofan IR switch 48, a power connection 72, and a TV set 55, according toone embodiment of the present invention.

Turning to FIG. 18 it is seen that an IR switch 48 has a powerconnection 72. IR switch 48 is operative to communicate acoustically,typically with a mobile device (not shown), via microphone 50 andspeaker 52. IR switch 48 is also operative to transmit IR code via IRtransmitter 54, thereby to control a TV set 55, which receives the IRcode via IR receiver 73. IR switch 48 is typically placed in front of TVset 55, to provide a direct line of sight that allows an IR transmissionfrom transmitter 54 to receiver 73. Alternately, a power cable 74 isoperative to be bent, thereby to allow IR switch 48 to be connected to apower socket on a wall, for example behind TV set 55, and then turnedtowards receiver 73 on the TV set 55.

Reference is now made to FIG. 19, which is a simplified illustration ofmobile device 42, wireless router 75, IR switch 48, power connection 72,and TV set 55, according to one embodiment of the present invention.

Turning to FIG. 19 it is seen that a mobile device 42, equipped with awireless Internet connection and speech-recognition capability, presentsa TV controller screen to user 60. The screen includes: On/Of buttons,volume Up/Down and channel Up/Down buttons. A speech-recognitioncapability for mobile phones is provided, for example by Apple's Siri.Mobile device 42 is typically also equipped with room detectioncapability as described above with reference to FIGS. 16 and 17.

In the present example mobile device 42 has received a voice command bythe user for “volume up”. Based on the room wherein mobile device 42 islocated, mobile device 42 determines which appliance needs to receivethe command, and communicates the appliance's number and said command'snumber to an Internet server. A wireless router 75, in communicationwith the Internet server, received the appliance and command numbers,and communicates them to an IR switch 48, thereby to transmit the properIR code to the required appliance, a TV set 55 in the present example.

Router 75 and IR switch 48 communicate wireless via Wi-Fi wirelessmechanism, Zigbee specification protocol, Bluetooth wireless standardand/or any suitable wireless communication method. Alternately or inaddition, wireless router 75 and IR switch 48 communicate via power-linecommunication, which also allows wireless router 75 to communicate withmultiple IR switches 48 around the house.

Reference is now made to FIG. 20, which is a simplified flowchart of aprocedure 76 for associating mobile device 42 with a particularappliance, according to one embodiment of the present invention.

FIG. 20 describes a procedure whereby a home appliance is added to aremote control system which is typically similar to the system describedabove with reference to FIGS. 9 and 10.

Turning to FIG. 20, it is seen that a mobile device presents to the usera list of appliance types such as TV sets, DVD recorders, stereo soundsystems and the like, the list being typically downloaded from theInternet. Following a selection of an appliance type by the user, themobile device downloads from the Internet and presents to the user alist of manufacturers of the appliance type. Following a selection of amanufacturer by the user, the mobile device downloads from the Internetand presents to the user a list of models of the appliance by themanufacturer. Following a selection of a model by the user, the mobiledevice downloads from the Internet the IR operating codes for the model,and then acoustically communicates the codes to an IR switch. Followingthe reception and storage of the IR codes by the IR switch, the IRswitch communicates a confirmation signal to the mobile device, which inturn displays a confirmation announcement to the user.

Reference is now made to FIG. 21, which is a simplified flowchart of aprocedure 77 for operating mobile device 42 as a remote controller,according to one embodiment of the present invention.

FIG. 21 describes a procedure for a mobile device which functions withina remote control system for home appliances, which system is typicallysimilar to the system described above with reference to FIG. 11.

Turning to FIG. 21, it is seen that a mobile device presents to the usera list of appliance types such as TV sets, DVD recorders, stereo soundsystems and the like, which list includes previously added appliances,and is typically stored on the mobile device. Following a selection ofan appliance type by the user, the mobile device displays to the user alist of previously added appliance models of the selected type.Following a selection of an appliance model by the user, the mobiledevice displays to the user a remote-control screen for the selectedmodel. The mobile device is now ready for receiving a control command bythe user, which the user supplies by means of a button themobile-device's touch screen and/or by voice received via themobile-device's microphone.

Following the reception of a command by the user, the mobile deviceretrieves from its memory the command number and/or the related IR codefor the command. The mobile device then acoustically communicates thecommand number to an IR switch, which is operative to retrieve from itsmemory the related IR code and transmits it to the required appliance.Alternately, while using an IR switch without a memory unit, the mobiledevice acoustically communicates to the IR switch the related IR code,which the IR switch directly transmits to the required appliance.Following the reception of an acoustic confirmation signal by the IRswitch, the mobile device awaits further commands by the user. Whereasis a confirmation signal by the IR switch is not received after aprescribed delay, an error announcement is displayed to the user.

Alternately, the mobile device communicates with the IR switch viaWi-Fi, Bluetooth, Zigbee, or any other suitable wireless communicationmethod.

Alternately, power line communication is employed, using the followingsystem: The mobile device wirelessly communicates the command code to anInternet server, and the command is received by a power line router,which is operative to communicate the command to the required IRswitches from among one or more power-line IR switches around the house.

Reference is now made to FIG. 22, which is a simplified flowchart of aprocedure 78 for operating mobile device 42 as a remote controller,according to one embodiment of the present invention.

FIG. 22 describes a procedure for a mobile device which functions withina remote control system for home appliances, which system is typicallysimilar to the system described above with reference to FIGS. 8 and 9.

Turning to FIG. 22, it is seen that a mobile device is ready to receivea button or voice command be a user, while continuously tracking theuser room ID. Room ID is typically tracked via beacon signals by IRswitches, which are located in different rooms and communicate,typically acoustically, the room ID to the mobile device. Once a commandby the user is received by the mobile device, such as “volume up” in thepresent example, the mobile device retrieves the related IR code for therequired appliance based on the user room ID. In the present example, inthe bedroom the required appliance is the TV set, whereas in the livingroom the required appliance is the audio surround system. The related IRcode for executing the command for the required appliance is theacoustically communicated by the mobile device to the IR switch, whichis operative to transmit the required IR code to the appliance inquestion.

Reference is now made to FIG. 23A and FIG. 23B, which are two simplifiedflowcharts of procedures 79 and 80 for an IR switch 48, according to oneembodiment of the present invention.

FIGS. 23A and 23B describe procedures for an IR switch which functionswithin a remote control system for home appliances, which system istypically similar to the system described above with reference to FIG.11. FIG. 23A describes a procedure for an IR switch 48 that typicallydoes not include a considerable memory unit. FIG. 23B describes aprocedure for an IR switch 48 that includes a memory unit beingoperative to store one or more IR code libraries for one or moreappliances.

Turning to FIG. 23A, it is seen that an IR switch receives an acoustictransmission of data, typically by a mobile device. The data includes adescription of an IR code, which the IR switch is operative to transmitvia its IR transmitter. Following the IR transmission, the IR switchacoustically communicates a confirmation signal to the mobile device.According to the procedure of FIG. 23A, the IR switch typically requiresonly a very small memory which includes the IR code for “1” and “o”.Namely, the acoustic signal by the mobile phone includes a series ofbits, each of which is either 1 or 0, and the IR switch converts eachbit to a proper IR signal such as, for example: “1”=20 milliseconds IRsignal+10 milliseconds no-signal; and “0”=10 milliseconds IR signal+20milliseconds no-signal.

Turning to FIG. 23B, it is seen that an IR switch receives an acoustictransmission of an appliance number and an appliance number, typicallyby a mobile device. The appliance and button numbers refer to appliancedata which were previously added to the control system, typically asdescribed above with reference to FIG. 20. The IR switch then retrievesfrom its memory unit the IR code that is related to the button for theappliance, as previously stored, for example, in the course of an “addappliance” procedure of FIG. 20. The IR switch then transmits the IRcode via its IR transmitter. Following the IR transmission, the IRswitch acoustically communicates a confirmation signal to the mobiledevice.

Reference is now made to FIG. 24, which is a simplified flowchart of aprocedure 81 for an mobile device 42 in a learning mode, according toone embodiment of the present invention.

FIG. 24 describes a procedure for a mobile device which functions withina remote control system for home appliances, which system is typicallysimilar to the system and learning mode as described above withreference to FIG. 12.

Turning to FIG. 24 it is seen that in response to selecting a learningmode by the user, the mobile device acoustically communicates a signalto the IR switch, thereby to cause the IR switch to enter the learningmode. Then, in response for a button or voice command by the user, themobile device acoustically communicates the command code to the IRswitch. A feedback signal by the IR switch is then received the mobiledevice, which is then ready to receive another button or voice commandby the user. The feedback signal is transmitted by the IR switch afteran IR code which corresponds to the command code has been received bythe IR switch. The IR code has been supplied by the user via a remotecontroller of the appliance in question. The process is repeated untilall the required button codes have been transmitted to the IR switch andthe storage of their corresponding IR codes has been confirmed. Then,following an exit command by the user, the mobile device acousticallycommunicates an exit signal to the IR switch, thereby to cause the IRswitch to communicate the entire code table including all the IR codesthat have been received through the learning process. The code table isthen uploaded by the mobile device to the Internet, thereby to beavailable for future download by the same or other users.

Reference is now made to FIG. 25, which is a simplified flowchart of aprocedure 82 for an IR switch 48 in a learning mode, according to oneembodiment of the present invention.

FIG. 25 describes a procedure for an IR switch which functions within aremote control system for home appliances, which system is typicallysimilar to the system and learning as described above with reference toFIG. 12.

Turning to FIG. 25 it is seen that an IR switch enter a learning modefollowing a transmission of a learning mode command by a mobile device.The IR switch then receives an acoustic transmission from the mobiledevice, informing the IR switch of an appliance number and a buttonnumber. The numbers are then stored on the IR switch in a memory codetable, and the IR switch awaits a transmission of the corresponding IRcode, which the user supplies via the remote controller of theappliance. Once received by the IR switch, the IR code is stored in thememory code table, together with the appliance and button numbers towhich it is related. A feedback signal is then transmitted the mobiledevice, thereby to inform the user that another button can be selected.The process is repeated until all the required IR codes have beenreceived by the IR switch and their storage in the memory code table hasbeen confirmed. When a transmission of an exit command is received fromthe mobile device, the IR switch transmits to the mobile device theentire memory code table and exists the learning mode.

Reference is now made to FIG. 26, which is a simplified illustrationshowing a mobile device 42, a CANbus switch 83, and a vehicle 84,according to one embodiment of the present invention.

Turning to FIG. 26 it is seen that a mobile device 42, equipped withspeech-recognition capability, presents a vehicle controller screen tothe user including: On/Of buttons, front window Up/Down and rear windowUp/Down buttons, and a start-engine button. A speech-recognitioncapability for mobile phones is provided, for example by Apple's Siri.Mobile device 42 communicates acoustically with an CANbus switch 85, viaspeaker 86 and microphone 87 on mobile device 42, and speaker 88 andmicrophone 89 on CANbus switch 90. Alternately, Mobile device 42 andCANbus switch 91 communicate via an RF method such as Wi-Fi, Zigbee,Bluetooth and the like.

CANbus switch 92 is connected to the vehicle CANbus 93, a centralcontroller system for the vehicle appliances, and is thereby operativeto control the appliances. Alternately of in addition, CANbus switch 94is operative transmit IR code, thereby to control at least some of theappliances.

Based on the vehicle's model and appliances, a controller unit isdownloaded to the mobile device from the Internet, including all thecontrol functions that required for the appliances. A stereo audiosystem, for example, is also connected to the vehicle's CANbus 93, andcan be controlled via this system.

In the present example, the user has given a series of speechcommands—“Open Door”, “Radio On”, “CBS news”, and “Volume 32”—which arereceived by mobile device 42 via microphone 87. Mobile device 42 detectsthe user's presence in the vehicle, based, for example, on beacontransmission from CANbus switch 95. Mobile device 42 is thereforeoperative to transmit an acoustic command to CANbus 93, causing CANbus93 to activate the required appliances.

Reference is now made to FIG. 27, which is a simplified illustration ofan acoustic toy system 96, according to one embodiment of the presentinvention.

Turning to FIG. 27, it is seen that acoustic toy system 96 includes atoy 97, a handheld device 98 such as a Smartphone or iPad, a wirelessrouter 99 communicating with handheld device 98, and a remote server100, which is typically available for communication via a communicationnetwork 101 such as the Internet, Handheld device 98 typically includesa speaker 102 and a microphone 103. Server 100 typically stores datafiles 104, including sound files.

As seen in FIG. 27, the voice of a user 60 is received by microphone 103of handheld device 98. Typically, handheld device 98 is placed next totoy 97, so that user 60, typically a child, receives the impression oftalking to toy 97. The user's voice input is typically analyzed by aspeech-recognition engine, which runs on handheld device 98, such as theSiri speech-recognition engine by Apple. Alternately or in addition, aspeech-recognition engine is provided on server 100, with which handhelddevice 98 communicates via wireless router 99.

Having analyzed the user's voice-input, server 100 provides anappropriate response to be provided to the user via toy 97. In thepresent example, user 60 says “Can you sing?” Having detected the user'sspeech, server 100 selects a suitable data file 104, such as a songtitle from a suitable song database. The selection is typically based onthe user's profile. Server 100 then generates a verbal response andcommunicates it to handheld device 98. The verbal response is typicallygenerated in the form of data packets of condensed coded audio, whichare suitable to be spread in an acoustic transmission, thereby to beprovided via toy 97.

Alternately, server 100 generates a text response and communicates it tohandheld device 98, which in turn generates the digital coded audio, tobe spread in an acoustic transmission.

Typically, server 100 provides not only audio data for toy 97, but alsopuppeteering data, which determine the position of a toy's one or moremotors in a manner which is synchronized with the toy's audio content.Content data, which include both audio content and synchronized motionsfor toy 97, are therefore communicated by server 100 to handheld device98.

Handheld device 98 typically communicates with toy 97 by means of anacoustic transmission, which device 98 transmits via speaker 102 andwhich is received by toy 97 via a suitable microphone on toy 97. Theacoustic transmission typically includes a low-volume transmission inthe frequency range of 15-20 KHz, namely on the upper verge of theaudible range. Being low-volume, this transmission is effectivelyinaudible to the human ear. This acoustic transmission channel isoperative to transmit data bits of a condensed coded audio, and istherefore suitable for the transmission of audio data for toy 97, aswell as synchronized puppeteering data (also available as data file104). Alternately or in addition, handheld device 98 communicates withtoy 97 via Bluetooth, WiFi, IR transmission or any other wirelesstransmission which is suitable for the transmission of data bits ofcondensed audio and puppeteering data.

An acoustic transmission including condensed coded audio is received bytoy 97 and processed by a DSP unit on toy 97. Typically, the acoustictransmission is digitized, thereby to locate the data bits of condensedaudio. The data bits are edited into a digital audio file, typicallyusing a VoCoder, such as G723 Vocoder, which is operative to encode orcondense and redevelop digital audio data. The digital audio file isthen transmitted acoustically from the handheld device 98 to the toy 97,and converted back into analogue using G723 decoder, and provided as anaudible audio content by toy 97 via a speaker on toy 97. The acoustictransmission typically also include synchronized puppeteering data,based on which the DSP unit of toy 97 activates on or more motors of toy97, thereby to move the toy's eyes, lips, arms and/or any other part,synchronized with the toy's audio output. The acoustic transmissiontypically also include a toy ID number, to enable the handheld device tocommunicate with plurality of toys, each has its unique ID number.

It is appreciated that throughout the procedure of the acoustic toysystem of FIG. 27, the user only hears the audio output that is providedvia toy 97, while all other wireless transmissions—including theacoustic transmission of coded audio which handheld device 98communicates to toy 97—remain inaudible to the user.

It is also appreciated that the acoustic toy system of FIG. 27 isparticularly advantageous in that it receives a voice-input by a uservia handheld device 98, while providing an audio output via toy 97. Thisparticular construction avoids the need for an expensive microphone ontoy 97, as well as the need for a wireless channel for high rate datafrom the toy to the handheld device, which would be required for thetransmission of audio for the purpose of speech-recognition. The toy cantherefore be made cheaper, requiring only a microphone for the receptionof coded data and a speaker for providing regular audio output. At thesame time, through its communication with handheld device 98, toy 97receives all the benefits of Internet connectivity including the songdatabase on server 100, as well as the speech recognition engine, whichit typically provided via the handheld device itself.

Reference is now made to FIG. 28, which is a simplified schematicillustration of acoustic toy system 96, with a block diagram 105 of toy97, according to one embodiment of the present invention.

FIG. 28 shows a typical interior construction of acoustic toy 97(represented in FIG. 28 by block diagram 105), which is provided as partof an acoustic toy system 96, which might be similar to the systemdescribed above with reference to FIG. 27. Turning to FIG. 28 it is seenthat acoustic toy system 96 includes toy 97, wireless router 99communicating with handheld device 98, and remote server 100 typicallycommunicating via the Internet and via wireless router 99 with handhelddevice 98.

As seen in FIG. 28, 97 typically includes a DSP unit 106, a microphone107, a speaker 108, an analogue-to-digital converter 109, adigital-to-analogue converter 110, one or more motor controllers 111,and one or more sensors 112, all controlled by DSP unit 106. Handhelddevice 98, such as a Smartphone or iPad, typically includes a speaker102 and a microphone 103,

As seen in FIG. 28, a user's voice input is received by microphone 103on handheld device 98. Typically, handheld device 98 is placed next totoy 97, so that user 60, typically a child, receives the impression oftalking to toy 97. The user's voice input is typically analyzed by aspeech-recognition engine, which runs on handheld device 98, such as theSiri speech-recognition engine by Apple. Alternately or in addition, aspeech-recognition engine is provided on server 100, with which handhelddevice 98 communicates via wireless router 99.

Having received a request for a song by the user, server 100 retrieves adata file 104, such as a song title from a suitable song database,typically based on the user's personal profile including the user's age,native language, and/or history of previous requests. Server 100 thengenerates a data file for a response to be made by toy 97, which datafile typically includes packets of condensed audio data as well assynchronized puppeteering data (also available as data file 104). Theone or more data files 104 are then communicated to handheld device 98,which is operative to transmit it coded within an inaudible acoustictransmission.

Handheld device 98 typically communicates with toy 97 using acoustictransmission. Handheld device 98 transmits the one or more data files104 coded as acoustic transmission via speaker 102. The coded acoustictransmission is then received by via microphone 107 on toy 97.

The acoustic transmission typically includes a low-volume transmissionin the frequency range of 15-20 KHz, namely on the upper verge of theaudible range. Being low-volume and high frequency, this transmission iseffectively inaudible to the human ear. This acoustic transmissionchannel is operative to transmit data bits of a condensed coded audio,and is therefore suitable for the transmission of audio data for thetoy, as well as synchronized puppeteering data. Alternately or inaddition, handheld device 98 communicates with the toy 97 via Bluetooth,WiFi, IR transmission or any other wireless transmission which issuitable for the transmission of data bits of condensed audio andpuppeteering data.

Having received the acoustic transmission by handheld device 98 viamicrophone 107, the toy using the DSP 106, converts the transmissioninto a digital data file via analogue-to-digital converter 109. DSP unit106 receives the digital data file, locates the condensed audio packets,encodes and redevelops them using typically G723 algorithms, andconverts them into a digital audio data. The audio data is converted bydigital-to-analogue converter 110, and then provided as audio output viaspeaker 108. DSP unit 106 also locates the synchronized puppeteeringdata in the digital data file, and actuates motor controllers 11according to the puppeteering data.

It is appreciated that toy 97 can sing and make synchronized motions inaccordance with request made by the user, without the user being awareof the data transmissions between the server, the handheld device andtoy 97.

DSP 106 also operative to receive feedback indications via one or moresensors 112 on toy 97, which are then coded and communicated to handhelddevice 98 in an acoustic transmission via speaker 108. The same acoustictransmission from the toy to handheld device 98 typically also includesindications on the toy's status such as toy battery-low alert and thelike. It is appreciated that this acoustic return channel, while notbeing essential to the voice interactivity of the acoustic toy system,involves only coded data which do not require high rate and aretherefore appropriate to inexpensive speaker and DSP 106 on toy 97.Alternately, sensor feedback and toy status indications are communicatedby toy 97 to handheld device 98 via Bluetooth, WiFi, or any othersuitable wireless communication transmission.

Reference is now made to FIG. 29, which is a simplified illustration ofan acoustic multi-toy system 113, according to one embodiment of thepresent invention.

FIG. 29 shows an acoustic toy system including a plurality of toys 97.Multi-toy system 113 may be similar to the acoustic toy system 96described above with reference to FIGS. 27 and 28. Turning to FIG. 29,it is seen that an acoustic toy system 113 includes a plurality of toys114, a handheld device 115 such as a Smartphone or iPad, a wirelessrouter 116 communicating with handheld device 98, and a remote server117, which is typically available for communication via a communicationnetwork 118 such as the Internet. Handheld device 98 typically includesa speaker 119 and a microphone 120. Server 100 typically stores datafiles 121, including sound files. Toys 97 are typically situated in thevicinity of handheld device 98. Typically, each toy is registered uponbeing purchased, typically via a home computer, by providing a toy'sunique ID as well as a toy's name, which may be selected by the user.

As seen in FIG. 29, user 60 voice input is received by microphone 103 onhandheld device 98. Typically, handheld device 98 is placed next to oneor more toys, so that a user, typically a child, receives the impressionof talking to one of the toys. The user's voice input is typicallyanalyzed by a speech-recognition engine, which runs on handheld device,such as the Siri speech-recognition engine by Apple. Alternately or inaddition, a speech-recognition engine is provided on server 6, withwhich handheld device 98 communicates via wireless router 99.

In the present example, the system detects an address by the user toparticular toy 97 designated by numeral 122. Addressing the toy 122 isbased on the toy's name as registered on server 100. Server 100generates a particular data file 104 for a response to be made by toy122. The data file 104 typically includes both the toy ID of toy 122, aswell as packets of condensed audio data. The data file 104 typicallyalso includes synchronized puppeteering data. The data file 104 is thencommunicated to handheld device 98, which is operative to transmit itcoded within an inaudible acoustic transmission.

Handheld device 98 typically communicates with one or more toys 97 bymeans of an acoustic transmission. Handheld device 98 transmits anacoustic transmission via speaker 102 which is received by toys 97 viasuitable microphone embedded in toys 97. The acoustic transmissiontypically includes a low-volume transmission in the frequency range of15-20 KHz, namely on the upper verge of the audible range. Beinglow-volume, this transmission is effectively inaudible to the human ear.This acoustic transmission channel is operative to transmit data bits ofa condensed coded audio, and is therefore suitable for the transmissionof audio data as well as synchronized puppeteering data for the toys.Alternately or in addition, handheld device 98 communicates with toys 97via Bluetooth, WiFi, IR transmission or any other wireless transmissionwhich is suitable for the transmission of data bits of condensed audioand puppeteering data.

In the present example, the acoustic transmission by handheld device 98includes the toy ID of toy 122, and therefore the transmission isreceived and processed only by a DSP unit on toy 122 (and not by toy 97designated by numeral 123). Typically, the acoustic transmission isdigitized, thereby to locate the data bits of condensed audio. The databits are transmitted acoustically to toy 97, and encoded back to audio,typically using a VoCoder, such as G723 Vocoder, which is operative todecode and redevelop digital audio data. The digital audio data is thenconverted into analogue and provided as an audible audio content by toy97 via a speaker on toy 97. The acoustic transmission typically alsoinclude synchronized puppeteering data, based on which the DSP unit oftoy 122 activates one or more motors of toy 122, thereby to move thetoy's eyes, lips, arms and/or any other part, synchronized with thetoy's audio output.

It is appreciated that the acoustic toy system of FIG. 29 allows a userto address a particular toy out of group of toys 97, while the user'svoice input is received via a handheld device 98 which is placed in thevicinity of toys 97. Furthermore, the same toy 97 can be interactedwith, using different handheld devices 98, since the toy details areregistered on a remote Internet server.

Reference is now made to FIG. 30, which is a simplified illustration ofan acoustic toy system 113_and a TV set 124, according to one embodimentof the present invention.

As seen in FIG. 30, a user's voice input is received by microphone 103on handheld device 98. Typically, handheld device 98 is placed next toone or more toys, so that a user, typically a child, receives theimpression of talking to one of the toys. The user's voice input istypically analyzed by a speech-recognition engine, which runs onhandheld device 98, such as the Siri speech-recognition engine by Apple.Alternately or in addition, a speech-recognition engine is provided onserver 100, with which handheld device 98 communicates via wirelessrouter 99.

In the present example, the system detects a request by the user(“Kitty, tell me when SpongeBob show starts on TV”) to receive, via toy122, a notification of a particular TV show. Server 100 generates a datafile for a response to be made by toy 122, which data file typicallyincludes both the toy ID of toy 122, as well as packets of condensedaudio data. The data file typically also includes synchronizedpuppeteering data. The data file is then communicated to handheld device98, which is operative to transmit it coded within an inaudible acoustictransmission.

Server 6 also generates a notification script that allows the system toprovide a notification to the user via toy 122, once the TV-showrequested by the user starts. The notification script is communicated tohandheld device 98, transmitted acoustically to toy 122 via speaker 102,and sets the DSP unit on toy 122 to await the TV-show. The TV-show istypically to be detected via unique TV-show data which are included inthe TV audio. Typically, a TV show data are coded into the TV audio andspread along the TV audio file, for example, every 0.1 second. The datatypically include a TV show ID number and TV time line data, therebyallowing the detection not only of the TV show itself, but also theexact position along the TV show's episode.

Once the TV show starts on TV set 7, an acoustic transmission of thepreviously coded TV-show's details is provided via speaker 8. Theacoustic transmission is received by toy 122, via a suitable microphone,and the TV-show data coded therein are detected by the DSP unit on toy122. A notification is then transmitted acoustically or via other meansof wireless transmission such as Bluetooth or WiFi, from toy 122 tohandheld device 98, which communicates the notification to server 100.It is appreciated that this data transmission from toy 122 to handhelddevice 98 does not involve high data rates. Alternately, the acoustictransmission by TV-set 124 is received directly by handheld device 98,and the TV-show data coded therein are detected by a processor onhandheld device 98. Still another option is that the acoustictransmission by TV-set 7 is received by server 100 via microphone 103 onhandheld device 98.

Once a notification is received by server 100, a synchronized data filefor toy 122 is communicated by server 6 to handheld device 98, therebyto be acoustically transmitted to toy 122. Toy 122 then verballynotifies the user that the requested TV-show has begun, and typicallyprovides audio output as well as motions which are synchronized with theTV-show. In particular, toy 122 provides one or more verbalnotifications to the user, notifying the user that a specific pointalong the TV-show's timeline has been reached.

Alternately, a TV-show is detected by handheld device 98 via aspeech-recognition engine on the device 98, detecting, for example, akey sentence at the beginning of an episode. This option avoids the needto provide previously coded TV-show data inside the TV-show audio file.However, employing previously coded TV-show data which can be detectedacoustically as mentioned above, allows for a higher detection range.

It is appreciated that the systems described above with reference toFIGS. 27, 28, 29, and 30 enable communicating audio, such as sound andspeech, over audio. The acoustic communication technology used by thesystems of FIGS. 27, 28, 29, and 30 enables transmission of a compressedaudio file within the upper part of the audio band, where, for example,the audio band is 15 Hz-20 KHz, and the upper band is 15 KHz-20 KHz.

It is appreciated that the systems described above include two devicesor more, where each device includes a processor, a memory, a speaker forproviding sound to a user, a microphone for receiving sound from a user,an audio compression module, and/or an audio decompression module, and asoftware program stored in the memory and executed by the processor. Thesoftware program uses the speaker and/or the microphone to communicateacoustic communication, where the first device compresses audio, andtransmits it using the acoustic communication, and the second devicereceives the compressed audio using the acoustic communication, anddecompresses the communicated compressed audio.

It is therefore possible to communicate at the same time (concurrently)uncompressed audio, compressed audio, and data (e.g. control signalssuch as puppeteering data). For example, it is possible to transmit viaa TV speaker, in addition to the broadcasted audio, compressed audiofiles and puppeteering data to a toy.

Reference is now made to FIG. 31, which is a simplified block-diagram ofa toy audio file, according to one embodiment of the present invention.The toy audio file of FIG. 31 is typically employed in accordance withan acoustic toy system which may be similar to the acoustic toy systemdescribed above with reference to FIG. 27.

Turning to FIG. 31, it is seen that a toy audio file includes audio datapackets of 0.1 second length, each packet includes a synchronized motiondata, which updates the position of the toy's one or more motors. Thetoy's motors typically control the toy's head, arms, eyes motion, andthe like. It is appreciated that employing the toy audio file of FIG. 31in an acoustic toy system as described above with reference to FIG. 27,allows the activation of a toy to provide audio output as well asmotions that are synchronized therewith.

Reference is now made to FIG. 32, which is a simplified flowchart of aplay script, according to one embodiment of the present invention. Theplay script of FIG. 32 is typically employed in accordance with anacoustic toy system which may be similar to the acoustic toy systemdescribed above with reference to FIG. 29. A play script is typicallyrun on a suitable Internet server such as server 100 of FIG. 29 and/oron handheld device such as handheld device 98 of FIG. 29, which may be aSmartphone or an iPad.

Turning to FIG. 32 it is seen that an acoustic toy system awaits asensor indication or a voice input by a user. A voice input by a user istypically received by a handheld device that is placed next to a toy,and analyzed by the handheld device via a suitable speech-recognitionengine such as Siri by Apple. The system detects, for example, a userrequest for a song, and a toy's name. Using the user's previouslyregistered personal details, which include toy ID's and names of thetoys owned by the user, the system is operative to determine the toy IDnumber of the toy addressed by the user. Using the user's previouslyregistered details including age, habits, language and history ofprevious requests, the system is operative to make an appropriateselection of a content item for the user: For example, in response to auser's request for a song, the system selects from a music database, asong that most strongly matches the above-mentioned personal details ofthe user.

Having retrieved an appropriate response to the user, the systemgenerates a data file for the toy in question, which data file typicallyincludes condensed audio data, synchronized motion data, and a toy IDnumber. Typically the data file is generated by an Internet server,communicated to the user's handheld device, which in turn transmits itacoustically to the required toy. The user's personal data file on theserver database is then updated with the details of the interactionincluding, for example, a request for a song by the user, and theparticular content provided to the user.

Reference is now made to FIG. 33, which is a simplified flowchart of anacoustic toy main program, according to one embodiment of the presentinvention. The acoustic toy main program of FIG. 33 is typicallyemployed in accordance with an acoustic toy system which may be similarto the acoustic toy system described above with reference to FIGS. 28and 29. An acoustic toy main program is typically run on a suitable DSPunit, which may be similar to DSP unit 106 of FIG. 28, and typicallylocated inside a toy.

Turning to FIG. 33 it is seen that the program awaits a command by aserver, for the toy ID in question. Typically, an Internet server suchas server 100 of FIGS. 28 and 29 generates a data file for a toy, whichdata file typically includes both the toy ID of the toy in question, aswell as packets of condensed audio data. The data file typically alsoincludes synchronized puppeteering data which is adapted to the specifictoy. The data file is then communicated to a handheld device, such ashandheld device 98 of FIGS. 28 and 29, which is operative to transmitthe data coded within an inaudible acoustic transmission. Alternately orin addition, the handheld device wirelessly transmits the data file tothe toy via Bluetooth, WiFi, or IR transmission.

Having received a command file for the toy ID in question, the DSP unitchecks whether the file includes both audio and motion content for thetoy. If audio data are included, the data are converted to analogueaudio using the DSP running a G723 vocoder, and via adigital-to-analogue converter, and provided as an audio output via thetoy's speaker. The toy's one or more motors are activated based on themotion data included in the command file.

Typically a command file for the toy has a structure of successive 0.1second audio packets, each followed by a motion data packet, asdescribed above with reference to FIG. 31. The toy's motions aretherefore synchronized with the toy's audio output. This audioconversion and/or toy motor activation continues until the end of thecommand file, and then the system return to its initial position.

As also seen in FIG. 33, as long as no command file for the toy isreceived, the system is operative a user input via one or more toysensors. Once such a sensor is being activated by a user, the sensor'snumber and the toy's ID number are acoustically transmitted via thetoy's speaker, to be received by a handheld device. Alternately the dataare being wirelessly transmitted from the toy to the handheld device viaBluetooth, WiFi, or IR transmission. The data are then received andresponded to by application which runs on the handheld device or on anInternet server with which the handheld communicates.

It may therefore be appreciated that a DSP unit on an acoustic toyperforms a rather simple routine procedure which involves the receptionand transmission of relatively simple data and requires no high datarates.

Reference is now made to FIG. 34, which is a simplified flowchart of anotification script, according to one embodiment of the presentinvention.

The notification script of FIG. 34 is typically employed in accordancewith an acoustic toy system which include one or more TV shows withencoded data, and which might be similar to the acoustic toy systemdescribed above with reference to FIG. 30. A notification scripttypically runs on a handheld device and/or an Internet server, such ashandheld device 98 or server 100 of FIG. 30.

Turning to FIG. 34 it is seen that the system awaits audio watermarkingsync data. These data are typically coded into the TV audio of the TVshow in question, and spread along the TV audio file, for example, every0.1 second. The data typically include a TV show ID number and TV timeline data, thereby allowing the detection not only of the TV showitself, but also the exact position along the TV show's episode. As theTV show in question is broadcasted, an acoustic transmission by TV-setis received by a handheld device via the device's microphone, and theaudio watermarking sync data coded therein are detected by a processoron the device, or communicated to an Internet server to be detected bythe server. Having detected the TV show's ID number and time-line data,the handheld device communicates them to the Internet server.

Reference is now made to FIG. 35, which is a simplified flowchart of aTV show synchronization procedure, according to one embodiment of thepresent invention.

The TV show synchronization procedure of FIG. 35 is typically employedin accordance with an acoustic toy system which include one or more TVshows with encoded data, and which might be similar to the acoustic toysystem described above with reference to FIG. 30. A TV showsynchronization procedure typically runs on a handheld device and/or anInternet server, such as handheld device 98 or server 100 of FIG. 30.

Turning to FIG. 35 it is seen that an acoustic toy system awaits TV showsynchronization data. The data are typically communicated to the systemvia a handheld device, which detects the data coded in an audiotransmission by a TV set. These data are typically spread along the TVaudio file, for example, every 0.1 second. The data typically include aTV show ID number and TV time line data, thereby allowing the detectionnot only of the TV show itself, but also the exact position along the TVshow's episode. As the TV show in question is broadcasted, an acoustictransmission by TV-set is received by a handheld device via the device'smicrophone, and the audio watermarking sync data coded therein aredetected by a processor on the device, or communicated to an Internetserver to be detected by the server. Having detected the TV show's IDnumber and time-line data, the handheld device communicates them to theInternet server as described above with reference to FIG. 34.

Having received the TV show synchronization data, the system updates oneor more game application scripts for toys, which applications aredesigned to provide audio and/or motion content for the toys insynchronization with the TV show in question.

Reference is now made to FIG. 36, which is a simplified flowchart of TVshow play script, according to one embodiment of the present invention.

The play script of FIG. 36 is typically employed in accordance with anacoustic toy system which include one or more TV shows with encodeddata, and which might be similar to the acoustic toy system describedabove with reference to FIG. 30. A play script typically runs on ahandheld device and/or an Internet server, such as handheld device 98 orserver 100 of FIG. 30.

Turning to FIG. 36 it is seen that a system awaits a notification of aparticular TV show. The notification is typically being detected viaaudio watermarking sync data which are coded into the TV show audio, asdescribed above with reference to FIG. 30. Once the TV show'snotification has been detected, the system communicates a voice outputfile to the particular acoustic toy that is supposed to provide theoutput to the user. For example, an Internet server such as server 100of FIG. 30 communicates the file to a handheld device such as devicehandheld device 98 of FIG. 30 or FIG. 32. The output file for the toytypically includes condensed audio data for the toy, a toy ID number ofthe toy in question, and typically also synchronized puppeteering datafor the toy—the toy names “Kitty” in the present example.

The system is then operative to execute the play script via the toy insynchronization with the TV show. Typically, the handheld deviceacoustically transmits the voice file embedded in a low-volume acoustictransmission in the frequency range of 15-20 KHz, which is inaudible tothe human ear, or in any other wireless mean like WiFi or Bluetooth orIR. Toys in the handheld device's vicinity receive the acoustictransmission via suitable microphones. Based on the toy ID number codedinto the acoustic transmission, the play script is executed only by thetoy to which it is intended.

Reference is now made to FIG. 37A, which is a simplified flowchart of atoy notification script, according to one embodiment of the presentinvention.

The notification script of FIG. 37A is typically employed in accordancewith an acoustic toy system which include one or more TV shows withencoded data, and which might be similar to the acoustic toy systemdescribed above with reference to FIG. 30. A notification scripttypically runs on a DSP unit inside an acoustic toy, such as toy 97 ofFIG. 30.

Turning to FIG. 37A it is seen that the system is operative to detectaudio watermarking sync data. These data are typically coded into the TVaudio of the TV show in question, and spread along the TV audio file,for example, every 0.1 second. The data typically include a TV show IDnumber and TV time line data, thereby allowing the detection not only ofthe TV show itself, but also the exact position along the TV show'sepisode. As the TV show in question is broadcasted, an acoustictransmission by TV-set is received by an acoustic toy device via amicrophone on the toy, and the audio watermarking sync data codedtherein are detected by a DSP unit on the toy. Having been detected bythe DSP unit, the TV show's ID number and time-line data are typicallyacoustically transmitted via the toy's speaker, to be received by ahandheld device such as device 98 of FIG. 30. Alternately the data arebeing wirelessly transmitted from the toy to the handheld device viaBluetooth, WiFi, or IR transmission. The handheld device then typicallycommunicates the data to an Internet server.

Reference is now made to FIG. 37B, which is a simplified flowchart of aphone notification script, according to one embodiment of the presentinvention.

The notification script of FIG. 37B is typically employed in accordancewith an acoustic toy system which include one or more TV shows withencoded data, and which might be similar to the acoustic toy systemdescribed above with reference to FIG. 30. A notification scripttypically runs on a handheld device, such as device 98 of FIG. 30.

Turning to FIG. 37B it is seen that the system is operative to detectaudio watermarking sync data. These data are typically coded into the TVaudio of the TV show in question, and spread along the TV audio file,for example, every 0.1 second. The data typically include a TV show IDnumber and TV time line data, thereby allowing the detection not only ofthe TV show itself, but also the exact position along the TV show'sepisode. As the TV show in question is broadcasted, an acoustictransmission by TV-set is received by a handheld device via the device'smicrophone, and the audio watermarking sync data coded therein aredetected by a processor on the device, or communicated to an Internetserver to be detected by the server. Having detected the TV show's IDnumber and time-line data, the handheld device communicates them to theInternet server.

Reference is now made to FIG. 38, which is a simplified block-diagram ofa TV show sound track, according to one embodiment of the presentinvention.

The TV show sound track of FIG. 38 is typically employed in accordancewith an acoustic toy system which include one or more TV shows withencoded data, and which might be similar to the acoustic toy systemdescribed above with reference to FIG. 4.

Turning to FIG. 38, it is seen that a TV show sound track includes awatermarking and/or coding of a TV show ID number, which is repeatedevery 0.1 second along the sound track. The TV show sound track alsoincludes a watermarking and/or coding of the TV show time line data,namely data of the location of a current position along the TV showsound track. The TV show sound track is typically acousticallytransmitted by a TV set via the TV-set's speaker, and received by anacoustic toy system via a suitable microphone on a handheld deviceand/or an acoustic toy which wirelessly communicates with a handhelddevice.

If the TV-set's acoustic transmission is received by a toy, the TV-showdata coded therein are detected by the DSP unit the toy. A notificationis then transmitted acoustically or via other means of wirelesstransmission such as Bluetooth or WiFi, from the toy to a handhelddevice, which communicates the notification to a suitable Internetserver. It is appreciated that this data transmission from the toy tothe handheld device does not involve high data rates. Alternately, theacoustic transmission by the TV-set is received directly by a handhelddevice, and the TV-show data coded therein are detected by a processoron the device. Still another option is that the acoustic transmission bythe TV-set is received by the Internet server via the microphone on thehandheld device.

It is appreciated that employing the sound track of FIG. 38, an acoustictoy system can detect the broadcast of a particular TV show at anyparticular time point along the TV show's timeline (with a 0.1 secondresolution). Similarly, the acoustic toy system can detect anyparticular time point along the TV show's timeline (with a 0.1 secondresolution). It is therefore appreciated that employing the sound trackof FIG. 38, the acoustic toy system of FIG. 30, is operative to activatea toy to respond to a TV-show and to provide both verbal and motionoutput which is synchronized with the TV-show's content.

It is appreciated that certain features of the invention, which are, forclarity, described in the context of separate embodiments, may also beprovided in combination in a single embodiment. Conversely, variousfeatures of the invention, which are, for brevity, described in thecontext of a single embodiment, may also be provided separately or inany suitable sub-combination.

Although the invention has been described in conjunction with specificembodiments thereof, it is evident that many alternatives, modificationsand variations will be apparent to those skilled in the art.Accordingly, it is intended to embrace all such alternatives,modifications and variations that fall within the spirit and broad scopeof the appended claims. All publications, patents and patentapplications mentioned in this specification are herein incorporated intheir entirety by reference into the specification, to the same extentas if each individual publication, patent or patent application wasspecifically and individually indicated to be incorporated herein byreference. In addition, citation or identification of any reference inthis application shall not be construed as an admission that suchreference is available as prior art to the present invention.

What is claimed is:
 1. A computer program product embodied on anon-transitory computer readable medium, said non-transitory computerreadable medium provided in a mobile device, wherein said mobile deviceis operative to communicate with an intermediating switch within a firstrange, wherein said intermediating switch is operative to control atleast one service providing device within a second range; wherein saidsecond range is smaller than said first range, and wherein said computerprogram product comprises: a module for interrogating said at least oneintermediating switch, by said mobile device; a module for receivingfrom said intermediating switch, by said mobile device, responsive tosaid interrogation by said mobile device, identification data of saidservice providing device; a module for presenting to a user of saidmobile device a list comprising at least one of said service providingdevices within said second range; and wherein acoustic communication isused for said interrogation, wherein said acoustic communication is usedby at least one of said service providing device and said mobile device.2. The computer program product of claim 1, additionally comprising:using a first wireless communication technology, by at least one mobiledevice and said at least one service providing device, for communicatingwithin said first range; and using a second wireless communicationtechnology for communicating within said second range, wherein saidsecond wireless communication technology is different from said firstwireless communication technology.
 3. The computer program product ofclaim 1, additionally comprising: providing a plurality of serviceproviding devices each associated with a respective location; presentingto a user at least one of said locations; receiving from a user aselection of a location; and presenting to said user a list of serviceproviding devices associated with said location.
 4. An intermediatingswitch comprising: a first communication module communicatively coupledwith a mobile device within a first range, a second communication moduleoperative to control at least one service providing device within asecond range, wherein said second range is smaller than said firstrange; wherein said first communication module is operative to receivean interrogation from said mobile device and to respond to saidinterrogation by identifying said at least one service providing deviceto said mobile device using acoustic communication for saidinterrogation, wherein said acoustic communication is used by at leastone of said service providing device and said mobile device.
 5. Theintermediating switch of claim 4, additionally comprising: using a firstwireless communication technology for communicating within said firstrange; and using a second wireless communication technology forcommunicating within said second range, wherein said second wirelesscommunication technology is different from said first wirelesscommunication technology.
 6. The intermediating switch of claim 4,wherein using acoustic communication uses at least one of: a speakerembedded in said intermediating switch; and a microphone embedded insaid intermediating switch.
 7. The intermediating switch of claim 4,wherein said control of at least one of said service providing devicesby said intermediating switch is conditioned by said service providingdevice being interrogated by said same mobile device.
 8. Theintermediating switch of claim 4, additionally comprising: saidintermediating switch communicating with a third communication deviceusing at least one of RF communication technology, wirelesscommunication technology, power-line communication technology, andinfra-red communication technology.